Method 1 - Babbitt Score 



(1 100) For a given variable, for all 
observations, convert provided values 
into proxy values, if necessary. 






(1200) For a given variable, for all 
observations, segregate proxy values 

associated with the variable into 
categories (e.g., Top 2 box, Top 3 box. 
etc.) 


^ 


r 


(1300) For each category, determine 
values' distribution by dividing number 
of provided values in category by total 
number of provided values 




f 


(1400) Calculate a top category score 
by adding the top category distribution 
{%) to the bottom category distribution 
{%) and subtracting an ideal 
distribution of neutrals (%) and 
multiplying an absolute value of the 
result by 100 






(1500) Calculate a difference score by 
subtracting the bottom category 

distribution (%) from the top category 
distribution (%) and multiplying an 
absolute value of the result by 100 






(1600) Calculate an effectiveness 
(Babbitt) score for the variable by 
adding the top category score to the 
difference score 







(1700) Evaluate the variable based on 
the effectiveness score 



Method 2 - Bestfit Clustering 



(2100) For each observation, obtain dataset, 
each dataset having observation IDs, variables, 
possible values, provided values, and (where 
applicable) proxy values for provided values 



(2200) Specify a number of clusters, 
any desired variable weights, and a 
maximum number of iterations for the 
clustering solution 



(2300) Develop initial cluster 
assignments: Select only 1 path within 
(2130) 



(2350) Read specified initial cluster 
assignments (already present in 
dataset, cf. Method 3) 



j The # of clusters is an integer > 0. 
" ! The # of iterations is an integer > 0. 



• Throughout Method 2, variable 

j weights (where applicable) are 

; incoroporated within fitness score 

; calculation (cf. Method 10) 



(2360) Systematic Search: Identify 
the pair of variables that creates a 
clustering solution that maximizes 
fitness score using the specified 
number of clusters 



(2370) Thorough Search: Identify any 
two variables that together create a 
clustering solution that maximizes 
fitness score using the specified 
number of clusters 
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r 


i 


f 


(2361) Discover the 1 variable that 
creates a clustering solution that 
maximizes fitness score using the 
specified # of clusters 




(2371) Discover the 1 variable that 
creates a clustering solution that 
maximizes fitness score using the 
specified # of clusters 




r 




T 



(2362) Hold the variable from (2361) 
constant and discover the variable that 
in tandem creates a clustering solution 
that maximizes fitness score using the 
specified # of clusters 



(2372) Hold variable from (2371) or 
(2373) constant and discover the 
variable that in tandem creates a 
clustering solution that maximizes 

fitness score using the specified # of 
clusters 



(2373) Hold variable from (2372) 
constant and find the variable that in 
tandem creates a clustering solution 
that maximizes fitness score 



Repeat this process by 

cycling through all 
possible combinations 
of variable pairings until 

fitness score as 
calculated In (2373) Is 
maximized 



(2400) Store observation IDs, corresponding 
cluster IDs, fitness score 




To Fig. 2b 



Fig. 2a 



Method 2 - Bestfit Clustering - Continued 




FROM (2400) 



(2450) For each cluster and variable, 
calculate the mode of provided values, 
and (where applicable) proxy values 
for provided values 



(2460) Store cluster IDs, variable IDs, 
and corresponding modes from (2450) 



From (2591) 



(2470) Select a fraction of 
observations, divided evenly among all 
specified clusters from the dataset 



(2480) Randomly re-assign the 
observations from (2470) to different 
clusters 



It is preferable that 
observations be chosen 
randomly; furthermore it is 
preferrable that the exact 
fraction never exceed 10% of 
the entire datasefs population 
of observations 



From Fig. 2c 



(2490) For each cluster and variable, 

calculate the mode of provided 
values, and (where applicable) proxy 
values for provide d values 



(2500) Calculate fitness score for the 
clustering solution developed in (2480) 



(2505) Store fitness score, duster 
assignments, and observation IDs 



□ 

□ 

fcsb 



From (2550) 



(2510) Select one random observation 
from a random cluster and change its 
cluster assignment 



(2520) Calculate fitness score of 
(2510) 

i 



(2530) Conditional function: Compare 
fitness score of (2520) with (2505) 



Only proceed If looping 
from (2550) 



(2531) If fitness score of (2520) 
< or = fitness score of (2505), 
cycle through all possible cluster assignments 
for observation selected In (2510) until fitness 
is maximized 



(2536) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2532) Conditional function: Compare 
maximum fitness score of (2531) with (2505) 



(2533) If fitness score of (2520) 
< or = (2505), return selected 
observation to original cluster 
assignment 




(2535) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2540) Store 
Observation IDs 
and new cluster 

assignments 



(2550) Replace 
(2505) with (2540) 
and return to (2510) 



Hold the other observations in 
their current cluster 
assignments from (2505) 



(2551) If fitness score of 
(2520) = (2505), 
proceed to (2560) 



(2552) If fitness score of 
(2520) < or > (2505). 
return to (2540) 



T _ 

To Fig. 2c 



Fig. 2b 



Method 2 - Bestfit Clustering - Continued 




FROM (2551) 



To (2470) 



1 



(2560) End Iteration 



: Steps (2510) 
| through (2560) i 
i represent 1 Iteration i 



(2570) Store Iteration ID, 
Observation IDs, corresponding 
cluster assignments 



Iteration ID is a positive integer <= the 
total # of specified iterations. Its value 

increases serially in the form 
x + 1 where x = previous iteration ID. 



(2580) Conditional function: 
compare Iteration ID from 
(2570) with total # of iterations 
specified in (2200) 



Us, 
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TSBS" 



(2581) If Iteration 
ID from (2580) < 
total # of iterations 
specified in (2200), 
return to (2470) 



(2582) If Iteration 
ID from (2580) = 
total # of iterations 
specified in (2200), 
proceed to (2600) 



(2600) Store Iteration ID that produced maximum 
fitness score, maximum fitness score, observation 
IDs, and corresponding cluster assignments that 
produced maximum fitness score 



(2610) Dump data from (2600) 
into a file of usable format (e.g. 
ASCII, .csv, .txt, .pm) 



(2620) Terminate 



Method 3 - Champion/Challenger 
Clustering Refinement 



(3010) For each observation, obtain dataset, 
dataset having variables, possible values, 
provided values, and (where applicable) 
proxy values for provided values 






(3020) Append initial cluster assignments 
to dataset (so they correspond to 
Observation IDs) 




r 


(3030) Specify maximum number of 
iterations 




r 


(3040) Execute (2450) to (2610) of 
Method 2 




f 


(3050) Terminate 



Fig. 3 



(4010) For each observation, obtain dataset 
having a cluster assignment for the 
observation and having a proxy value for 
each of the variables in the dataset, each 
variable having possible values 



(4020) For each observation, estimate a 
purposeful probability (a measure of a 
proability that an observation in a particular 
cluster provides an answer to a question in 
a non-random manner) that a particular 
possible value for a particular variable will 
be provided by observations assigned to a 
particular cluster 



(4021) Create probability variables 
for each cluster, variable, answer 
combinations as p ^ ^ 



(4022) Estimate the probability that answer 
valued is given by the observations in 
cluster m for a variable k that has L k 
possible answers 



(4023) Define 8 within a constraint that 
allows for usable output 



(4025) For each observation, 
store and/or output the 
purposeful probability 



I 



(4024) Computational process is executed 
across all 



D 





(4030) For each observation and 
each possible value, calculate a 
serendipity probability (a measure 
of a probability that an observation 
in a particular cluster will be 
associated with any of the 
possible values for a particular 
variable) 








If a observation / In cluster m \ 
selected responses j 
"randomly," then the j 
probabilities of selecting his j 
responses should be 
described as ! 

i ! 

^ ! 



(4050) For each observation, assume that 
before observation made, observation has 
an equal probability of being in any cluster 



(4055) For each observation, assume that 
the purposeful probabilities are true 



(4060) For each observation calculate a Bayes 
probability that a particular observation can be 
in each cluster conditional upon the 
observation's proxy value 



(4065) For each 
observation, store and/or 
output the Bayes probability 



(4035) For each observation, 
calculate a ratio of purposeful 
probability to serendipity probability 



(4040) For each observation, calculate a log of 
the ratio to obtain a composition analysis score 



(4045) For each observation, store and/or 
output the composition analysis score 



If S = 0, the resulting 
over-precision of the 

calculated probabilities 
compromises 

computational efficiency 



S = min 



is a value that produces 
meaningful results 



Let N m - total # of observations in 
cluster m;N m (k,e) = toe#oi 
observations in duster m who give the 
&th answer value to variable *; and 



5 = min 



0.02 



If observation i in cluster m 
"purposefully" and "logically" 
selected his responses, then the 

probabilities of selecting his 
responses should be described by 



P n (ht) 



.'. Calculate 

NB: n means calculate P for each 
fk...,K) where k-1\ 

£ retains its 
customary function 



i 



(4080) For each observation, calculate a 
percent of proxy values for the variables 
that equals a mode of that observation's 
cluster's proxy values for the 
corresponding variables 



(4085) For each 
observation, output 
the calculated 
percent 



(4090) Classify each observation based on results obtained in 
activity (4045), (4065). and/or (4085) 



Method 5 - Segmentation-on-the-Fly 



(5100) Obtain dataset for observations, 
dataset having variables, possible 

values, provided values, and 
corresponding cluster assignments 




For this flow chart, let the total set 
of variables be defined as {X} and 
the desired maximum # of 
variables to be used as k^^ 





(5200) Conditional function: Determine if 
cluster weights are needed to meet 
coverage or efficiency objectives 



Underweighting is used to implement 
i efficiency, while overweighting is used to I 
implement coverage 



(5210) If no weights are 
needed, proceed to (5300) 



(5220) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(5221). (5222). (5223) 




All clusters must be 
assigned weights, 
regardless of magnitude 





(5221) If cluster is to be 
unweighted, set weight 
as w= 1 



(5222) If cluster is to be 
overweighted, set weight 
as w > 1 



(5223) If cluster is to be 
underweighted, set 
weight as 0 < w < 1 



(5300) Begin approximating the clustering solution 
developed using Method 2 by developing clustering 
solutions that employ only 1 variable 
from (K) in each. 



y 
C3 



(5310) Create a "dummy" variable for each 
cluster so that if there are AS clusters, then 
M variables 



j In other words, if there are K variables. Sen K 
i. -9P*5i5??.5!? utions are created, 1 per k In fKJ 



Let designate a 
"dummy" variable for 
observation / in cluster m 



(5320) Conditional function: populate M variables 
per observation per clustering solution 



Let ( be a member of the set of 
observations (R), A be a member of 
the set of variables {KJ f and m be a 

member of a set of clusters {hi} 



+ 

(5321) If observation i is in 
cluster m, then = 1 



(5322) If observation i is 
not in cluster m, then Y^ = 0 



1 






(5330) Store all values for M 
variables for all observations 
for each clustering solution 






f 



Fig. 5a 




Method 5 - Segmentation-on-the-Fly - Continued 




(5340) Create a "dummy" variable for every 
variable-possible value combination so that 
if there are L k possible answers to variable 
*, then L k "dummy" variables are created 
for each observation i for each clustering 
solution 



So the total number of variables i 
created per observation per \— 
duster is K(LJ \ 



(5350) Conditional function: for observation / 
and variable k, populate L k variables per 
clustering solution 



(5351) If observation i 
gives the ^-th answer for 
variable *, then X. f .= 1 



(5352) If observation i 
does not give the £ -th 
answer for variable Jfc, 
then jr.,. = 0 



Let Xifr designate a 
"dummy" variable for 
observation i who can 
answer possible value £ or 
variable k 



(5360) Store all values for K(LJ variables 
for all observations per clustering solution 



(5370) For each duster in (MJ t use ordinary 

least squares to regress all for all 
observations in (R) per dustering solution 



Index is created by 
multiplying the linear 
approximation to the 

probability of an 
observation's duster 
assignment by that 
i duster's spedfied weight 



Regression occurs on: 



k\x m :keK,\<l>< Lk -x}} 



so that we can generate a linear approximation to the 
probability that an observation with a particular set of 
answers to the variables in (K) is in a particular duster 
within {M} 



(5380) Conditional function: construct a "simpler" 
dustering solution to the one generated using 
Method 2 (Bestfit dustering) 



(5381) If weights were spedfied 
in (5200), create an index for 
each observation's duster 
assodation 



By "simpler", what is meant is an 
approximation of the "actual" 
dustering solution using the 
specified constraints, in this case 
using only 1 variable within (K) 



(5382) If weights were not spedfied in (5200), assign 
each observation in {R} to the m-th duster in (MJ that 
gives the highest value of the linear approximation to 
the probabilities of being in any of the members of (Mj 
as calculated In (5370) for each dustering solution 



(5383) Assign each observation in (R) to the 
m-th duster in (M) that gives the highest 
index value for each dustering solution 



(5390) Store the outputs of regression (i.e. coeffidents and 
constants), variable IDs, observation IDs, "approximated" duster 

assignments, and actual duster assignments for all dustering 
solutions 



I 




Fig. 5b 
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Method 5 - Segmentation-on-the-Fly - Continued 




FROM (5390) 



From Fig. 5b 



(5400) Calculate accuracy 
scores for the results 
stored in (5390) for all 
clustering solutions 



Accuracy score = 
[# of observations whose 
approximated and actual 
cluster assignments are 
identical] divided by [the total 
# of observations in (RJ ) 



(5410) Select the stored 
solution from (5390) that 
maximizes accuracy score 



(5411) Store the outputs of regression (i.e. coefficients and constants), 
variable IDs, observation IDs, "approximated" cluster assignments, and 
actual cluster assignments for the solution that was selected in (5410) 



4 

(5420) Begin approximating clustering 
solutions using only 2 variables in each 



(5421) Hold variable k from 
(541 1 ) constant and now 
execute (5310) through (5400) 
for all possible pairs of k from 

(5411) and the 
(* + 1 yth variable 



(5422) Refine winning 2 variable solution 
from (5421) 



The pattern in 
(5423) Increases 
serially as the 
number of variables 
used to approximate 
the clustering 
solution from 
Method 2 increase 
serially 



(5423) Hold the 
(k + \yth variable from (5421) constant and now 
execute (5310) through (5411) for all possible pairs 

of the (* + lyth variable from (5421) and the 
remaining variables In {Kj, excluding the (k + ^)•th 
variable and variable * identified in (5411) 



(5430) Continue looping (5420) through (5423) by sequentially 
increasing the number of variables used in (5420) at the beginning of 
each loop until a maximized solution (in terms of accuracy score) is 
identified for a simpler clustering solution that uses k } variables to 
approximate the clustering solution identified in Method 2 



(5440) Select and store the outputs of regression, variable IDs, "approximated" cluster 

assignments (and corresponding observation IDs), actual cluster assignments (and 
corresponding observation IDs), and accuracy scores for only the maximized solutions 
for ail solutions created up through and including k variables 



(5450) Dump (5440) into a file with usabie data format 
(e.g. ASCII, .txt. .csv, .pm) 



Therefore if the (k + 2)-th 
variable is added to the pair 
of the k-th and (k + l)-th 
variables to create a 
clustering solution that best 
approximates the objective 
function (i.e. original 
clustering structure 
developed in Method 2), then 
In the refining process 

(5422), the 
(k + 2)-th variable is held 
constant while the k-th and (k 

+ I)-th variables are 
replaced with all remaining 
variables to test the triplet of 

variables that best 
approximates the results of 
Method 2 



(5460) Terminate 



Fig. 5c 



Method 6 - Behavioral Segment Scoring 



(6100) For each observation, obtain 
dataset, each dataset having variables, 
possible values, provided values, and 

corresponding cluster assignments 
(developed in Method 2) 



1 


r 


(6200) Transform all continuous variables 
into categorical or scalar forms 




r 


(6300) Conditional function: Refine 
dataset to facilitate analysis 



Dataset can consist of 
any combination of 

scalar, categorical, and 
continuous variables 



Analyze distribution bound ari e s with" in a " " 
series of ranges to find the boundaries that 
create as normal distributions as possible; 

linear optimization is the most efficient 
method for executing this 



(6310) If dataset 

has <= 100 
variables, proceed 
to (6400) 



(6320) If dataset 

has > 100 
variables, reduce 
dataset as much 
as possible 



(6321) Execute the following 
analyses: 

- log scores 

• tree analysis 

- regression 

- discriminant analysis 



(6322) Remove variables 
identified in any 3 of 4 of the 
techniques in (6321) as "non- 
contributorsVinsignificant" 



These are standard 
statistical techniques that 
can be done in a 
mathematical 
programming language 

like Fortran or stat 
software package like 
SPSSorSAS 



Although <= 100 variables 

is ideal (in terms of 
computational efficiency), 
do not force an arbitrary 
"cut-off" to ensure < =100 
variables are used In 
the dataset 
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Method 6 - Behavioral Segment Scoring - Continued 




FROM (6310) or (6322) 



From Fig. 6a 



(6400) Conditional function: Specify 
maximum # of behavioral variables to be 
used in solution set depending on 
computational and/or time constraints 



(6410) If there is a 
computational or time 
constraint, select a 
maximum # of behavioral 
variables to be used < 
total # of behavioral 
variables in the dataset 



(6420) If there is no 
computational or time 
constraint, make 
maximum # of behavioral 
variables to be used = 
total # of behavioral 
variables in the dataset 



rn 
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(6500) Conditional ft 
cluster weights ar 
marketing coven 
efficiency 


jnction: Determine if 
e needed to meet 
age or marketing 
objectives 



(6510) If no weights are 
needed, proceed to (6600) 



(6520) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(6520). (6522), (6523) 



(6521) If cluster is to be 
unweighted, set weight 
as w~ 1 



All clusters must be 
assigned weights, 
regardless of magnitude 

i 



(6522) If cluster is to be 
overweighted, set weight 
as w> 1 



(6523) If cluster Is to be 
underweighted, set 
weight as 0 < w < 1 



(6600) Execute steps 

(5300) to 
(5450) (of Method 5) 



(6700) Terminate 



Fig. 6b 



Method 7 - Panel Analysis 



This is needed to ensure 
that the clustering solution 
developed using this 

dataset is truly 
representative of a 
market/industry and just 

the function of an 
idiosyncratic group of the 
overall population 



Ahalyze'dlsfrfbution ~ 
boundaries within a series of 
ranges to find the 
boundaries that create as 
normal distributions as 
possible; linear optimization 
is the most efficient method 
t^execu_tin^th]s__ 



(7100) Conditional function: Ascertain 
use of panel data 



(7110) If use panel data as 
objective measures of 
behaviors to input into 
clustering executed using 
Method 2, follow this path 



(7111) Refine data 
collection instrument (e.g. 
survey) using invention I 

(i.e. Babbitt Score) 



(7112) Field data collection 
instrument within panel (e.g. 
IRI, Nielsen, Simmons, 
comSCORE, MRI) 



(7113) Extract observations 
from collected data to 
assemble a dataset that 
reflects a category's/ 
industry's underlying 
demographics 



(71 14) Obtain dataset for 
extracted observations, 
dataset having variables, 
possible values, and 
provided values 



(7115) Append panel-based 
behavioral variables to each 
corresponding observation 
in dataset 



(7116) Transform any panel 
variables that are 

continuous into categorical 
or scalar variables 



(7117) Input data set from 
(7116) into (2420) of BestFit 
Clustering and proceed with 
clustering 



(7120) If use panel data for 
post-clustering analyses 
(e.g. tracking, promotion, 

positioning) follow this path 



These 2 paths are not 
exclusive, but cannot be 
executed simultaneously. 
| However, path (71 10) can 
feed into path (7121). 



(7121) Conditional function: 
Data collection 



(7121.1) If dataset 
developed using 
path (7110), proceed 
to (7122.1) 



(7121.2) Refine data 
collection instrument (e.g. 
survey) using Babbitt Score 



(7122) Execute 
Methods 2 
through 4 



(7123) Execute 
Methods 2 
through 5 



(7123.1) Use typing tool developed in (7123) 
to cluster score a representative sample of the 
panel's members using an expedient contact 
channel (e.g. outbound telephone, e-mail/ 
electronic surveys, mail-based surveys 



(7124) Execute cluster-level 
analyses using panel data 



(7125) Terminate 



(7118) Terminate 



Fig. 7 



Method 8 - Overall Segment-Based Marketing Process 



(8100) Develop and Field 
Pilot Survey 



(8200) Refine Survey 



Babbitt Score 
Bestfit Clustering 



(8300) Field Full 
Enumeration Survey 



Append panel variables and/or other 
respondent-lvel behaviours (if applicable) 



111 

£3 



U 



If applicable 



(8850) Panel Analysis 



(8900) Develop Segment 
Insights 



(8950) Develop and Execute 
Marketing Ideas 



(8400) Clean Data 



(8500) Create Clusters 



(8600) Refine Clusters 



(8800) Append Panel 
Variables 



Composition Analysis 



Babbitt Score 

Champion/Challenger Cluster Refinement 
Panel Analysis 



Composition Analysis 



(8700) Segment-on-the-Fly 



(8750) Behavioral Segment 
Scoring 



Fig. 8 



Information Device 9 
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1 — ► 


(9500) I/O 








(9400) Instructions 


— » 


(9300) Memory 






— ► 


(9200) Processor 






— ► 


(9100) Network 
Interface 



Fig. 9 



Method 10 - Fitness Score Calculation 



(10010) Calculate modes of given values for all 
variables in {K} for cluster n 



(10020) Store modes, corresponding 
variable IDs, corresponding cluster ID 



(10030) Calculate modes of given values for all variables 
in {K} for cluster n+y 



(10040) Store modes, corresponding 
variable IDs. corresponding cluster ID 



(10050) Conditional function: Assess 
the number of clusters for which 
modes have been calculated 



(10060) If the number of 
clusters for which modes 
have been calculated = N. 
proceed to (10080) 



T 



(10070) If the number of 
clusters for which modes 
have been calculated < N, 
return to (10030) 



Where n€ {tf}e{/} 

N consists of a finite # of clusters > 0. 
/ = domain of integers 



Where ke{K}e{l} 

K consists of a finite # of 

variables > 0. 
J = domain of Integers 



(10080) For each cluster, compare the 
value provided by each constituent 
member for variable A to the cluster's 
mode for variable k 



Where 



R consists of the set of observations, 
whose total number of 
constituents is > 0. 
/^.domajn^pfjntejejrs 



(10090) Conditional function: compare 
value of i* for k to the mode of k 



-\ Where / is a member of cluster n 



(10100) if equal, set 



(10110) if not equal. 
setK^-0 



k n is the variable k as answered by \ 
cluster n I 



(10120) Store score V M 



f Where V M = score for observation / 
j who is in cluster n and has provided 
answer value V for variable k 



(10130) Conditional function: adjust 
V M by indicated weight 



(10140) If weight was 
specfied, multiply V M 
by corresponding 
weight for k 



I 



(10150) If weight was 
not specfied. multiply 

^,!>y1 



J 



(10160) Store ^from (10140) or 
(10150) 



(10170) Repeat (10080) to (10160) until a 
score V is calculated for all observations in 
their respective clusters for alt variables * 



(10200) Sum all scores v for all 
observations across all variables 



(10300) Store fitness score 



(10400) Terminate 



! This Is the fitness score 



Fig. 10 



